Distribution of Time- Averaged Observables for Weak Ergodicity Breaking 
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We find a general formula for the distribution of time-averaged observables for systems modeled 
according to the sub-diffusive continuous time random walk. For Gaussian random walks coupled to 
a thermal bath we recover ergodicity and Boltzmann's statistics, while for the anomalous subdiffusive 
case a weakly non-ergodic statistical mechanical framework is constructed, which is based on Levy's 
generalized central limit theorem. As an example we calculate the distribution of X: the time 
average of the position of the particle, for unbiased and uniformly biased particles, and show that 
X exhibits large fluctuations compared with the ensemble average (X). 
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A central pillar of statistical mechanics is the ergodic 
hypothesis; which yields the equivalence of time and en- 
semble averages in the limit of long measurement time 
t. The Deborah number = tp/t is the ratio of the 
time scale of relaxation of the physical phenomenon un- 
der observation tp and the time of observation For 
a system to exhibit ergodic behavior must be small. 
Recently there is much interest in weak ergodicitybreak- 
ing Q , where the Deborah number diverges 0, 0jM S 0] ■ 
Weakly non-ergodic behavior is found in systems whose 
dynamics are characterized by power law distributed so- 
journ times in micro-states of the system, in such a way 
that the averaged waiting time is infinite (i.e. scale 
free dynamics). Weak ergodicitybreaking was investi- 
gated for blinking quantum dots I3| , intermittent nonlin- 
ear maps generating sub-diffusion deterministically ,5], 
numerical simulations of fractional transport in a wash- 
board potential [6 land in vivo gene regulation by DNA- 
binding proteins 7|. On the stochastic level, all these 
systems are modeled using the well known continuous 
time random walk (CTRW) approach or the correspond- 
ing fractional Fokker-Planck equation 0, [13, U | • Pre- 
viously, non-trivial statistics of occupation times for the 
CTRW model were found, and it is well established that 
time averages remain random variables even in the limit 
of long measurement time [3l ■ The main open theoretical 
challenge is to find the distribution of time averages of 
physical observables. Such a general theory, presented in 
this manuscript, gives analytical estimates for the statis- 
tical deviations of time averages from ensemble averages. 
The theory replaces standard ergodic statistical mechan- 
ics, and is applicable for a wide class of systems modeled 
using the CTRW or the related fractional Fokker-Planck 
equation. 

We consider the one-dimensional CTRW on a lat- 
tice, with lattice points x = 1,---,L. After waiting 
the particle can jump to one of its nearest neighbors, 
with probability qx it jumps to its left, and with prob- 
ability \ — qx to its right. The waiting times on lat- 
tice cells are independent identically distributed random 
variables with a common probability density function 
(PDF) ?A(t). We consider the widely applicable case 



[i, i, 0, im, nil, where the PDF of the waiting times 
behaves like ipir) - AaT"^"^ /\T{-a)\ with < a < 1, 
Aa > when r — > cxd. In this case the average waiting 
time is infinite and the Deborah number diverges. Such 
waiting times yield anomalous sub-diffusion and are well 
investigat ed M , S [13, II, E|, in the context of chaotic 
dynamics [l3| , geophysics [l4| , sub-diffusive chemical re- 
actions which are important in biological applications 



15 1 , and charge transport in amorphous semi-conductors 
16|, to name a few examples. The vast literature on the 



CTRW, deals mainly with ensemble averages of physical 
observables, for example the behavior of the ensemble av- 
erage of the coordinate (X) was thoroughly investigated 
in many physical situations. Here we investigate the time 
averages, for example we will find the distribution of X. 

Two types of CTRWs are considered. Thermal random 
walks describe a physical situation where the particle is 
coupled to a thermal heat bath with a temperature T 
[3, [l3|- In this case the jump probabilities qx satisfy 
usual detailed balance conditions which relate qx with 
an external force field F{x) acting on the system, and 
temperature T [3, [3, [l3|- When these conditions are 
imposed on the dynamics an ensemble of non-interacting 
particles attains Boltzmann equilibrium. A second class 
of random walks is non-thermal and this situation may 
describe a system far from thermal equilibrium. In this 
case the ensemble reaches an equilibrium which depends 
of-course on the transition probabilities qx (see details 
below). We will treat the non-ergodicity for both cases. 

We introduce two types of measurements which we 
identify with two different types of ensembles. In the 
first the time average of a physical observable is made 
for a fixed time t and i — > oo. Repeating the experiment 
many times, on an ensemble of trajectories, the distri- 
bution of the time average is constructed. In the second 
approach the number of jumps n the particle makes is 
fixed and n — > oo. So in the first ensemble, time is fixed 
and n fluctuates, while the opposite situation describes 
the second case. The fixed n fiuctuating time ensemble 
is very convenient for calculations, and as we discuss be- 
low yields the same results as the fixed time fiuctuating 
n approach. 
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We begin the analysis by considering the random walk 
where n is the operational time. The probability of occu- 
pying lattice site x after n jumps is given by the discrete 
time master equation 

(n + 1) = fc+iP^+i {n) + (1 - q^^i) P,_i (n) . (1) 

After many jumps n ^ cxd an equilibrium P^'^{n + 1) = 
P°'-^{n) is obtained, which satisfies 



(2) 



Such an equilibrium does not depend on the initial con- 
dition of the system 17|, and is reached provided that 
the system is finite, and that qx ^ ^ qx ^ ^ besides on 
the boundaries. 

We consider the number ensemble where n is fixed. 
The time tx spent by the particle in lattice cell x is called 
the occupation time. The total measurement time is t — 
X]x=i According to the CTRW model the time tx is a 
sum of independent identically distributed sojourn times 
with the common power law tailed PDF ^{t). Let Ux 
be the number of sojourn times in cell a;, which is clearly 
large when n ^ oo. For the discrete time random walk 
described by Eq. ^ we have nx/n = P^'^. Hence we may 
use Levy's generalized central limit theorem and obtain 
the PDF of tx 



f (tx) = L. 



(tx), 



(3) 



where the one sided Levy PDF Eq. ([3]) is in Laplace tx 
Ux space f{ux) = exp(— A^P^'^n-u"). For the ergodic 
case, a = 1 in Eq. we have f{tx) = S{tx — P°'^{T)n), 
where (r) ~ Ai is the averaged waiting time, and since 
n{T) ~^ t we have f{tx) = S{tx — Px'^t), as expected. 
The time average of a physical observable O is 



O 



x=lX 



(4) 



where = tx/t is the occupation fraction and Ox is the 
value of the physical observable when the particle is in 
state X. For example if the observable O is the position 
X of the particle we have X = Y1i^=q^Px- For usual 
ergodic systems and in the long time limit = P°'^ and 
then the time average is equal to the ensemble average 
O = {O) = T,x=i,lPx'^^^- When a < 1 the dynamics 
is non-ergodic and C is a random variable, even in the 
long time limit. 



To obtain the distribution of O we find now the 
L dimensional joint PDF of the occupation fractions 
PL{Pir ■ 'Pxt" 'Pl) [3- Fh-st note that the L occupa- 
tion fractions p^ are constrained according to the condi- 
tion J2x=iPx = 1; hence 

Pl{Pi,---,Pl) = ^ iy^^^Px^ g{Pir--PL^i,t)dt, 

.... 

where g (p^, ■ ■ ■ ,pj^_i, i) is the L dimensional joint PDF 
of the random variables in its parenthesis. Since the oc- 
cupation times tx are all independent we have 

9 {Pi, - ■ ■ ,PL~l^t) = 



d{ti,---,tL-i,t) 
d{Pir--,PL-i,t) 



L-l 



[n^=l 'q.AoP""™ {tx)] la.A^Pl'^n {^-'^tx 

\ x=^ 
(6) 



Calculating the Jacobian we obtain .g (pi, • ■ ■ , 
then using Eq. ([5]) and the identity 



(7) 



we find 



(8) 

This Eq. is the key for the calculation of the distribution 
of the time average O, as we will soon show. The multi- 
dimensional PDF of the occupation fractions Eq. ([8]) is 
independent of the number of steps n, and the detailed 
shape of the waiting time besides a of-course (e.g. Aa is 
not important). A derivation of Eq. ([8]) using the fixed 
time ensemble will be presented in a longer publication. 
To proceed we investigate the characteristic function 

(e~"^a!=i '^"'*^)t of the random variable 'Yl!^=i^xtx in 
Laplace t ^ s space 

(e-"ELi^==*==), = /°°e-^*(e""S^=i'^-*-)tdt (9) 
Jo 

Using Eq. ([8]) we obtain 



dt 



dy / dti 



dtrtS t 



L 

Y^tx 



^— / a;= 1 



3 



L-l 



dti 



dt 



ds 



cxp 



-p: 



icq f s+0^u \°' 

\ y J . 



(10) 

Solving the last integral we find the characteristic func- 
tion 



'EL.' 



(11) 



Using inversion technique found in |19l | , we transform Eq. 
([TT|) . and find the PDF of the time average O 



faiO) 



-ilimIm^-^^°^(^-^^ + ^^) 



a-1 



(12) 

This is our main result so far, it is a very general formula 
for the distribution of time-averaged observables and is 
valid for a CTRW on a lattice. In the limit a ^ 1 



U=i {O) ^5{0~ {O)) 



(13) 



which is the expected ergodic behavior. The opposite 
limit of a — > gives 



L 



=1 



(14) 



This makes perfect physical sense, since when a ^ the 
particle is localized for the whole duration of measure- 
ment in a single cell Note that our results can be 
easily generalized to dimensions higher than one. 

In many applications the continuum behavior of the 
CTRW is important. Dynamically this limit corresponds 
to the behavior described by the fractional time Fokker- 
Planck equation [l^, [ll[ . Taking the continuum limit of 
Eq. (HH) we find 

1 dxP'^'i (x) \0 - 0(x) + le] ""^ 

U (0)= limIm^^^^ ^ _ — 

e-o dxP^q (x) [O -0{x)+ le] 

... 

Here P°'' (x) dx is the equilibrium probability (in en- 
semble sense) of finding the particle in {x,x + dx) and 
< X < L. When the random walk is coupled to a ther- 
mal heat bath with temperature T, in the presence of an 
external force field F{x), the equilibrium of the ensemble 
is described by Boltzmann's statistics [^, [loj | 



P'^'^ix) 



exp 



kbT 



z 



(16) 



where Z is the partition function and F{x) — 
— dt^(x)/da;. As mentioned such an equilibrium is found 
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FIG. 1: The PDF of X/L for unbiased CTRW, simulations 
(crosses) versus theory (curves) Eq. (|19p . When a = 1 we 
find ergodic behavior and X = (X) = (i.e. the arrow sym- 
bolizing a delta function). For a = 0.7 (the dotted dashed 
curve) and a = 0.3 (the dashed curve) large fluctuations of 
time averages are observed. When a the PDF of X is 
uniform reflecting localization of the particle (solid line). 



for the CTRW model when detailed balance conditions 
are imposed on Qx- Solving Eq. (|15[) wg Iiclvg 



(O) 



(O) 



2cos™/> {0)I< (O) 
(17) 



where 



I<{0)^ _ dxP^^(x)\0~0[x)r (18) 

JO<0{x) 

and similarly for /> (O), /<„i (O) and I>^^ (O). The 
integration domain in Eq. (jl8p is for x satisfying the 
condition O < 0{x). 

As an example consider a particle in a domain — L/2 < 
X < L/2 undergoing an unbiased random walk. This is a 
free particle in the sense that no external field is acting 
on it. The time average of the particle's position X is 
considered, and obviously for this case P'^'^{x) — 1/L for 
-L/2 < X < L/2. Using Eq. ^ we find the PDF of 
the time-averaged position 

fa (X) = 



4 
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FIG. 2: Same as Fig. [T] for biased CTRW: now we show 
the PDF of X/{X). The theoretical curves based on Eq. 
(1201) perfectly agree with simulations (crosses) without fitting. 
A transition between ergodic behavior for a — 1 (the delta 
function) to localization behavior (solid curve a 0) where 
the PDF of X decays exponentially is found. 



We now discuss briefly the meaning of weak ergodic- 
ity breaking. In many situations in Physics a system is 
non-ergodic since its phase space is decomposed into re- 
gions of phase space where the system once starting in 
one region cannot explore the others. In this case time 
averages depend strongly on the initial condition of the 
system and there is no full exploration of phase space. In 
contrast for weak ergodicity breaking, the particle will 
visit each lattice cell many times, no matter what is its 
initial condition. Hence exploration of phase space is 
possible, and for this reason we were able to construct 
in this manuscript a general theory of non-ergodic statis- 
tical mechanics which is not sensitive to the initial con- 
ditions of the system. This has several implications, for 
example the joint PDF of occupation fractions Eq. ([5]) 
and the PDF of time averages Eqs. (|15ll7p are related 
to the population density P°'^{x). Therefore we may find 
a general relation between fluctuations of time averages 
and fluctuations of ensemble averages: using the small u 
expansion of Eq. (fTT|) 



N, 



a (4 



X 



2{l+a) 



2(1+q) 



1+a 



-(?)■ 

(19) 

where = (1 + a) sin7ra/(7ra). When a — > 1 we have 
the ergodic behavior X — (X) — while /q-+o (X) = 
1/L for |X| < L/2 which is the uniform distribution, 
reflecting the mentioned localization of the particle in 
space when a — > 0. In Fig. [1] comparison between our 
analytical results and numerical simulations [ill of the 
CTRW process with a fixed measurement time t, show 
excellent agreement without fitting. 

As a second example consider a biased particle in the 
domain < x < cxd and in a constant force field F > 0. 
Assuming the particle is in contact with a heat bath, 
with temperature T, Boltzmann's equilibrium is reached 
for an ensemble of particles, P'^'^{x) ~ cx-p{—Fx/ki,T)/Z. 
The PDF of X is found using Eq. ^ 



hT 



r (a) e^i" 



(^Jf^ dyey\y\°'^ + r2(l + a) + 2r(l + a) J^'' dyes' |?;|" cos 7ra 

(20) 

where x = FX/khT. When a —^ 1 we find ergodicity 
fi(X) = S(X-{X)) with (X) = kbT/F while in the op^ 
posite limit a ^ 0, an exponential decay of the PDF of X 
is found: liuia^o fa{X) = exp{—FX/kbT)/Z refiecting 
localization with a profile determined by the equilibrium 
density of many non-interacting particles. These behav- 
iors are demonstrated in Fig. [51 



{Of 



(l-a) 



O {xf P'^'i (x) (j^ O ^"^ i^) 



(21) 

while the average of O is {O) = (O) = /^^ OP°'i{x)dx. 
For the example of a particle in a uniform force field 
F, when the physical observable is the position, we have 
(X) = kbT/F and (x") - {Xf = (1 - a){kbT/Ff. 

To summarize we have obtained very general distribu- 
tions of time averages of physical observables of weakly 
non-ergodic systems Eqs. (|12ll7p . Unlike usual ergodic 
statistical mechanics where the time averages are equal to 
the ensemble averages, we find large fiuctuations of time 
averages. Due to the large number of applications of the 
CTRW model, and the recent interest in weak ergodic- 
ity breaking in dynamics of single particles, our theory is 
likely to find its applications in many systems. Due to the 
deep relations between the stochastic CTRW model and 
other models of anomalous diffusion, e.g. the quenched 
trap model, and deterministic dynamics, our non-ergodic 
theory might find further profound justification. 
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